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Abstract 

We generalize the Erdos-Renyi limit theorem on the maximum of par- 
tial sums of random variables to the case when the number of terms in 
these sums is randomly distributed. Relations between this limit theo- 
rem and the spectral theory of random graphs and random matrices are 
discussed. 
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1 Introduction 

The Erdos-Renyi limit theorem concerns the asymptotic behaviour of the ran- 
dom variables 

?7(n, fc)= max S^{k)/k, S^{k) = + ^i+i ^ l-^+fe, (1-1) 

i—l,....n — k 

where S = is a family of independent identically distributed (i.i.d.) 

random variables determined on the same probability space il and having zero 
mathematical expectation Ei^ — 0. It is assumed that the function 

0(r) = Ee«^ (1.2) 

is determined for t E I^, where C = (0, -l-oo). 

In 1^ it is proved that given 1 < C < oo there exists, with probability 1, a 
non-random limit 

lim r]{n, [C log n]) — a (1-3) 
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determined by relation 

inf (t){T)e-°'^ ^ e-^l^. (1.4) 

re/ 

In the particular case when are given as Bernoulli random variables 

^ _ . with probability 1/2, , , 

^^"^'^\-l, with probability 1/2, ^ ' 

convergence (1.3) holds with C = clogg 2, where a(c) is determined by relation 



c V 2 , 

with 

h{t) = -tlogat - (1 - t)log2(l - t), < i < 1. 

It is easy to see that in this case a takes values between the mean value = 
a(+cxD) and the maximum 1 — aiV) of random variables C,i. Obviously, one can 
also determine the limit a(c) for the values c S (0, 1); in this case it is equal to 
1. 

Further studies give more details about the convergence (1.3); in particular, 
the convergence in probability was proved in sand the estimates with probability 
1 were derived for the difference k) ~~ o;{C)] The Erdos-Renyi theo- 

rem has found several applications (see e.g. |ll|) and various generalizations 
of it have been considered (random variables indexed by sets, non-i.i.d. random 
variables, random variables in Banach spaces and others). 

One more version of this limit theorem is motivated by the studies of spectra 
of random matrices |^. Namely, when regarding the weighted adjacency matrix 
of a random graph, one observes that the spectral norm of such a matrix is 
bounded from below by the maximum of the sums Si{k) (1.1), where the number 
of terms k is distributed at random j^. Then, in the limit of large dimension 
of such a sparse random matrix, one faces the problem that can be called the 
stochastic version of the Erdos-Renyi limit theorem. It is clear that in this 
direction one can find different generalizations of the Erdos-Renyi theorem. In 
present paper we give the proof of the results announced previously |^ in the 
form maximally close to (1.1). We discuss other related settings at the end of 
the paper. 

Let us complete this introduction with expressions of gratitude to Profs. A. 
Rouault and E. Rio for the interest to this work and valuable discussions. 



2 Main result and discussion 

Let us consider the family of i.i.d. random variables A = determined 
on the same probability space as S, also independent from the family S. These 
Xi take values in N according to the law Pr{A — k} — q{k) such that EA = p. 
We assume that the function ^/'p(t) — Ee"^*, t E I\ C R_|_ exists, 

■iPp{t) = ePx(*)(i+°(i)) as p -> oo (2.1) 
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and x{t) is analytic and satisfies conditions x(i) ^ 0, x(0) = 0. It is easy to 
deduce from (2.1) that 

Pr{A >l}< inf V'pWe"" = p^oo, (2.2) 

where 

fiy) = sup [yt - x{t)] . (2.3) 

We assume that f{y) is the steep function, i.e. it takes value +oo when y goes 
beyond the domain of definition of /. Then by the Gartner-Ellis theorem (see 
e.g. §) 

Pr{A>yp}==e-f-'(f)(i+°(i», y>0, p^oo. (2.4) 

Let us note that f{y) is non- negative, strictly convex monotone function. It 
attains its minimal value at the point y' = (EX)/p = 1. 

Theorem 2.1 Let us consider the sums 

5.(A,)=e.+6+i + ...+6+A., (2.5) 
where {^i} are as in (1.1), and determine 

fi{n,p)^ max r]i{n,p), rii{n,p) ^ Si{\i)/p. 

i—l,...,n 

There exists with probability 1 a non-random limit 

lim fi{n,C\ogn) — a, (2.6) 



determined by the following relations: 
i)If 

D{a/y) = max 
then a — a{C) is determined by relation 



(XT 

log^(r) 

V 



(2.7) 



inf [f{y) + yD{&/y)] = 1 (2.8) 

y>0 G 

that generalizes (1-4) j 

ii) In the case of Bernoulli random variables — Q (1-5), convergence (2.6) 
holds with a = (5(c) determined by relation (cf. (1.6)) 



inf {f{y) + y 



2 2y) 



(2.9) 

c 



where c = C / logg 2 . 



To compare this theorem with results of , let us consider first the case (ii) 
of Bernoulli random variables. The next simplifying assumption is that Ai have 
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the Poisson distribution with parameter p. This makes (2.5) close to the model 
arising in the studies of sparse random matrices (see the end of this paper). One 
can easily derive that in this case x{t) — — 1, Ix = R+ and 



fiy) 

The function 



0, if 2/ e (0,1), 

y{\ogy - 1) + 1, if 2/ e [l,oo). 



gaiy) = y 



, , 1 a 

1 - ^ - + — 
2 2y 



(2.10) 



is positive and strictly decaying on (a, +oo); the maximum is attained at a and 
ffa(a) = a, g'a{a) = — oo. The solution of (2.9) exists for all c G (0, +oo) and 
linic^oo <5(c) = 0. This coincides with the value of a(+oo) = given by (1.6). 

It is not hard to show that a{c) > a{c) for all finite values of c. Moreover, 
(2.9) implies that a{c) infinitely increases as c — s- 0. This means that 

lim fi{n,p) — +oo, (2-11) 

l<Cp<Slog2 n 

while the corresponding value of a (c),c — > remains equal to 1. This is an 
important difference between the usual and stochastic cases of the Erdos-Renyi 
limit theorem (see Section 4). 

The reason for (2.11) is that in the limit c ^ the averaging in (2.5) is not 
sufRcient and fj{n,p) really searches for the maximum of variables rji. This is 
provided by those variables that have almost all Ci equal to 1; since one can see 
large deviations of the the number of terms in Si{Xi) with respect to p, then 
one can obtain infinite values of fj{n,p) (2.11). 

Thus, we conclude that the large fluctuations of q{l) in the scale p are re- 
sponsible for (2.11). This proposition is supported by the following observation. 
Let us forget the Poisson distribution of A and assume that there exists a finite 
interval Y C (0, oo) such that q{[py]) — o{e~P) for all y G F = R \ F. Then we 
determine f{y) as +00 on Y and still consider (2.9). In this case sup^ a(c) is 
finite. Finally, we observe that if f{y) is close to the Dirac (5-function 5{y — 1), 
then a(c) is close to the values a{c) given by (1.5). 

Summing up these arguments, we arrive at the conclusion that limcjo ct{c) = 
00 provided the fluctuations of around p are sufficiently large. 

It the general case of finite but unbounded random variables ^i, the limit 
a{C) as C ^ 1 can be infinite already in the classical case of A^ = fc = [Clogn],. 



3 Proof of Theorem 2.1. 

As in 0, we give the proof of the item (ii) concerning the Bernoulli random 
variables Ci and then describe the changes needed to prove Theorem 2.1 in the 
general case. 

Let us show that for any positive e 

Vv{f}(n,c\og2n) > a + e} ~ 0{n~^), n ^ oo, (3.1) 
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where S > depends only on e. We start with elementary inequality 

n 

Pr{ sup 7]i{n,p) > a;} < Pr{ryj(n,p) > a;} = nFv{r]i{n,p) > x}, 

i—l,...,n ■ 1 

where we used the fact that rji are identically distributed. Observing that {ui : 

r]i > x} C {oj : A > px}, we can write that 

Pr{7?i(n,p) >x}=Y, 9(0 Pr{^(0 > P^}- (3-2) 

l>px 

Using the Stirling formula, one can write that 

Elementary computation shows that the last sum is estimated by its first term 
stimes a constant. Then we obtain inequality 

Pr{5(0 >px}<^ 2-'[i-'*(5+3f)]. (3.3) 



If a; > a + s, then there exists S > that 

f{y) + y 



= f{y) + 9Ay)>^^ (3.4) 

for all y > 0. It is clear that the minimal value of f{y) is /(I) = 0. Since /(y) 
is strictly convex and monotone, it is continuous. Let us denote by z the value 
such that f{y) < 5/ {2c) for 1 < y < 2. Then for all < y < ^ 

cgx{y)>l + ^- (3.5) 

Using monotonicity oi gx{-)-i we derive from (3.3) inequality 

Pr{, >x}<( Y: +y]^i ,(/)2'KHlf )-i] < 

\px<l<pz pz<l J 

U ^ 2~P»'"('/P^ + 2~PS-('=)(i+°(i)) ^ q{l). 

xp<l<pz l^pz 

Taking into account that p = clog2 n, using (3.5) and combination of (2.2) and 
(3.4), we obtain that 

Pr{?7i(n,p) > a;} = 0{n-^-^/^) 

because the number of terms in the first sum is of the order 0(log2 n). Relation 
(3.1) is proved. 
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To prove the almost sure estimate, we follow the scheme of Q. Let us 
consider the sequence of random variables 

,7, ^7y(e(^"+i)/^-l,j). 

Then (3.1) implies convergence of the series J^j ^^'{Vj > Q^}- Now, taking into 
account that 77(71., Clog7T,) < fjj for all n such that e-'/*^ < n < e^i^^^l'^ — 1, we 
obtain relation 

Prjlim sup 77(71, Clog 77.) < 5} = 1. 

n — voo 

This completes the estimate from above of lim 77(71, clog2 for the case of 
Bernoulli random variables. 

In the general case one can use inequality (see e.g. [Q) 

Pr{5(/) > px} = (2^?6i)^'^'e-'^("/«) , (3.6) 

where 0<b<bi<B< 00, instead of (3.3). The remaining part of the proof 
repeats the arguments presented above. 

Now let us show that Prjmaxi rji < a — e'} vanishes as 7i — s- 00. To do this, 
we take an integer m and determine the subsets of 

Bn{m) = {uj ^ Q, : sup A.; < 771} 

2— l,...,n 

The next observation is that the events 

Ak{n,m) = {uj : rikrn+i{n,p) < x\Bnim)} 

are jointly independent for all < < 7i(m) — 1, 71(771) [ri/Tn]. Thus, we can 
write that 

n(m) 

Pr{sup7/i < a;|i?„(r77,)} = JJ^ Pr{Ak{n,m)} 

k=i 

^ / Pr{77i <xnBn{m)} 
" ^ Pr(B„(77i)) 

where we denoted rji = 771 (71, p). Regarding elementary relations 
Pr{FnB„(77z)} < 1- Pr{FnS„(77i)} 

and 

Pr{7:> n Bn{m)} = Pt{D} - Pt{D n Bn{m)} > Pt{D} - Pr{S„(77i)} 
with _F = {cij : 771 < a;} and D ^ F, we can write that 

Pr{f?i < a; n B„(to)} < 1 - Pr{?7i > x} + Pi-{Bjm)}. (3.8) 
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Let us considers Prjr/i > a;}. If a; < a{c) — e, then there exist 6' > and 
z' >1 that 



fiy)+y 



1-5' 

> , for all y > zi 



The Stirling formula implies the following inequality inverse to (3.3) 



2l J2 



{l+px)/2<j<l 



jj Vi 



> ^ 2-'[i-HH¥)]. 



(3.9) 



(3.10) 



Using this estimate and remembering monotonicity of the function gx{-) (2.10), 
we derive from (3.2) relation 

y>pzi 

Now (2.4) together with (3.9) imply that 

Pr{77i > a;} = 0{n-^+^'). (3.11) 

In the general case, one can use (3.6) instead of (3.10) and obtain (3.11). 

Let us estimate Pr{i?„(m)} < nPrjA^ > m}. We use again (2.2) and 
observe that if z" is such that f{z") > 3/C, then 

Pr{B„(m)} = 0{n-^), m = pz" , n ^ 00. (3.12) 

Now we can derive from (3.7), (3.8), (3.11) and (3.12) that 



Pr{supr,, < x\BUpz")} < ^ _Z^-2 ' 



0(n-2) 



Finally, writing inequality 



Pr{sup?7i < a;} < Pr{sup?7i < a;|B„(m)} Pr(S„(m)) + Pr{B„(m)} 

i i 

with m = pz", we get that 

Pr{fi{n,p) < a - e'} = 0{n~'^). 

Therefore Pr{liminf„^oo ?y(^, C'fog'^) > Oi} = 1. This completes the proof of 
Theorem 2.1. □ 



4 Applications to random graphs and random 
matrices 

Let us considcir the adjacency matrix A of & simple graph V with the sets of 
vertices and edges denoted by V and E, respectively. If | V] = N and the vertices 
are enumerated, then A\s dM N y. N real symmetric matrix with the entries 

AN)_{1, iftheedgee(z,i)e£;, , . 
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Often one calls the set of eigenvalues of A^^') the spectrum of F 

One of the models of random graphs (see e.g. |^) is determined by the 
ensemble {A^^'P^} of matrices whose entries {a^ , i < j} are given as a family 
of jointly independent random variables with distribution 

1, with probability p/A'^, 
0, with probability 1 ~ p/N. 

Having a random graph r'^'^', one can ask about the asymptotic behaviour 
of its spectrum when — s- oo, in particular, what happens with the maximal 
(minimal) eigenvalue of A^^'P\ This question was addressed in in more 
general setting than (4.1). 

Namely, the random matrix ensemble w[^'^^ = aijWij has been studied, 
where {wij, i < j} are jointly independent random variables, also independent 
from {ttij}. It is assumed that the probability distribution of Wij has all odd mo- 
ments zero m2k+i = and m2k < k^^^'^'>'^ with 7 > 0, A: > 1. Under these con- 
ditions, it was shown that the spectral norm of the matrix W^(^.p) = -^W<^^'P^ 
in the limit N,p 00 converges with probability 1 to the limits 

||w(JV,p)|i f 2w, ifp = 0{{logn)^+i), , . 

" ""l+oo, ifp = 0((logn)i-^)), ^^-^^ 



for any 7 > r. Here we denoted v — ^Ewfj, i,j = l,...N. 

Slightly modifying computations of |^ , one can show that the same conver- 
gence (4.2) is valid for the spectral norm of || |! with 7 > 0. 

To study the limit of p = ClogA^, one has to carry out more accurate 
analysis than that of |^ . One of the possible results can be obtained by using 
the Theorem 2.1. Indeed, one can write inequality 

> max 

i— l,...,n i— l,...,n 



where e{i)j — Sij. Observing that 

1 ^ 1 ^ 

T^{N,p) = - ^ a.jWy > - X! "'^j'^fs = Ti{N,p), 

^ i=i ^ j>i 

one faces the same problem as described in Theorem 2.1. Indeed, pTi(n,p) is 
given by the sum of independent random variables and the number of terms is 
given by \i = X^^j '^ij that approaches the Poisson random variables with 
parameters ip/N < p, respectively. Thus pTi[n,p) resembles Si{Xi) (2.5) with 
^ replaced by = w'jj . Let us denote 

H{N,p)= sup r,(iV,p) and7?(7V,p) = sup %{N,p). (4.3) 

1=1,. ...AT i=l,...,N 

So, the first difference between (2.5) and (4.3) is that 

E^- ^v^- >Q. (4.4) 
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However, it is easy to check that Theorem 2.1 remains vahd in the case of (4.4). 
Relations (2.6)-(2.8) do not change provided (j) (1.2) is replaced by <?!)(r) = Ee'^^. 
In this case q;(+oo) = v"^ . 

The foUowing proposition is true that 

lim iJ(A^,ClogA^) < a(C), (4.5) 

where a{C) is determined by (2.7) and (2.8) in terms of (/)(t). We put inequal- 
ity in (4.5) because the parameters of random variables A,; are of the order p 
provided i ~ 1 but decrease to zero when i increases up to N . This is another 
difference between H{N,p) and fi{n,p) (2.5). 

In this connection, it would be interesting to develop the analogs of the 
Erdos-Renyi limit theorem for maximums of and of T^. It is natural to expect 
that liniiJ(A^, Clog A^) = a{C). Of special interest is the study of asymptotic 
behaviour of also because in the limit C ^ cx) it is four times 

greater than that of a{C). 

Regarding the adjacency matrix A^^'P), it is shown in ||l0|] that its maximal 
eigenvalue is closely related with the maximal degree A of a random graph. Since 
the asymptotic behaviour of A is fairly well studied, this gives an important 
source of information on the spectra of random graphs. It could be interesting 
to find the limit of the spectral norm of A'^''"^ in dependence on C, where 
p^ C\ogN,N ^ oo. 

The behaviour of sums of the type (2.5) is interesting by itself in the following 
aspect. Assume that the random variables are such that EA^ = p but the 
second moment of A^ does not exists. Then it is interesting to know does the 
border p ~ logn still remain to be the critical one for the maximums f}{n,p). 
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